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Abstract 

In the set of stochastic, indecomposable, aperiodic (SIA) matrices, the class of stochastic Sarym¬ 
sakov matrices is the largest known subset (i) that is closed under matrix multiplication and (ii) the 
infinitely long left-product of the elements from a compact subset converges to a rank-one matrix. In 
this paper, we show that a larger subset with these two properties can be derived by generalizing the 
standard definition for Sarymsakov matrices. The generalization is achieved either by introducing an 
“SIA index”, whose value is one for Sarymsakov matrices, and then looking at those stochastic matrices 
with larger SIA indices, or by considering matrices that are not even SIA. Besides constructing a larger 
set, we give sufficient conditions for generalized Sarymsakov matrices so that their products converge 
to rank-one matrices. The new insight gained through studying generalized Sarymsakov matrices and 
their products has led to a new understanding of the existing results on consensus algorithms and will 
be helpful for the design of network coordination algorithms. 


I. Introduction 

Over the last deeade, there has been considerable interest in consensus problems [[D, [|2|, Q, 
0, a, il, 0, 0 that are concerned with a group of agents trying to agree on a specific value of 
some variable. Similar research interest arose decades ago in statistics a. While different aspects 
of consensus processes, such as convergence rates IfTOl . measurement delays IfTTI . stability 0, 
EH, and controllability [[T3l . have been investigated, and many variants of consensus problems, 
such as average consensus [IT4l . asynchronous consensus lim . quantized consensus ffTSl . and 
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constrained consensus [fT^ . have been proposed, some fundamental issues of discrete-time linear 
consensus processes still remain open. 

A discrete-time linear consensus process can typically be modeled by a linear recursion 
equation of the form 

x{k + 1) = P{k)x{k)^ k>l, (1) 

where x{k) = [xi{k),... ,Xn{k)Y ^ IR” and each P{k) is an n x n stochastic matrix. It is 
well known that reaching a consensus for any initial state in this model is equivalent to the 
product P{k) ■ ■ ■ P(2)P(1) converging to a rank-one matrix as k goes to infinity. In this context, 
one fundamental issue is as follows. Given a set of n x n stochastic matrices V, what are 
the conditions on V such that for any infinite sequence of matrices P(l), P(2), P(3),... from 
P, the sequence of left-products P(l), P(2)P(1), P(3)P(2)P(1),... converges to a rank-one 
matrix? We will call V satisfying this property a consensus set (the formal definition will be 
given in the next section). The existing literature on characterizing a consensus set can be traced 
back to at least the work of Wolfowitz in which stochastic, indecomposable, aperiodic 
(SIA) matrices are introduced. Recently, it has been shown in [fl^ that deciding whether P 
is a consensus set is NP-hard; a combinatorial necessary and sufficient condition for deciding 
a consensus set has also been provided there. Even in the light of these classical and recent 
findings, the following fundamental question remains: What is the largest subset of the class of 
n X n stochastic matrices whose compact subsets are all consensus sets? In [fT^ . this question 
is answered under the assumption that each stochastic matrix has positive diagonal entries. For 
general stochastic matrices, the question has remained open. This paper aims at dealing with 
this challenging question by checking some well-known classes of SIA matrices. 

In the literature, the set of stochastic Sarymsakov matrices, first introduced by Sarymsakov 
[f20ll . is the largest known subset of the class of stochastic matrices whose compact subsets are 
all consensus sets; in particular, the set is closed under matrix multiplication and the left-product 
of the elements from its compact subset converges to a rank-one matrix llUTl . In this paper, we 
construct a larger set of stochastic matrices whose compact subsets are all consensus sets. We 
adopt the natural idea which is to generalize the definition of stochastic Sarymsakov matrices 
so that the original set of stochastic Sarymsakov matrices are contained. 

In the paper, we introduce two ways to generalize the definition and thus study two classes 
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of generalized stoehastie Sarymsakov matriees. The first elass makes use of the eoneept of the 
SIA index (the formal definition will be given in the next seetion). It is shown that the set of 
n X n stoehastie matriees with SIA index no larger than k is elosed under matrix multiplieation 
only when k = 1, whieh turns out to be the stoehastie Sarymsakov elass; this result reveals why 
exploring a eonsensus set larger than the set of stoehastie Sarymsakov matriees is a ehallenging 
problem. A set that eonsists of all stoehastie Sarymsakov matriees plus one speeifie SIA matrix 
and thus is slightly larger than the stoehastie Sarymsakov elass is eonstrueted, and we show that 
it is elosed under matrix multiplieation. For the other elass of generalized Sarymsakov matriees, 
whieh eontains matriees that are not SIA, suffieient eonditions are provided for the eonvergenee 
of the produet of an infinite matrix sequenee from this elass to a rank-one matrix. A speeial 
ease in whieh all the generalized Sarymsakov matriees are doubly stoehastie is also diseussed. 

The rest of the paper is organized as follows. Preliminaries are introdueed in Seetion HIl Seetion 
Uni introduees the SIA index and diseusses the properties of the set of stoehastie matriees with 
SIA index no larger than k, > 1 . In Seetion UVl suffieient eonditions are provided for the 
eonvergenee of the produet of an infinite sequenee of matriees from a elass of generalized 
stoehastie Sarymsakov matriees, and the results are applied to the elass of doubly stoehastie 
matriees. Seetion |V] eoneludes the paper. 

II. Preliminaries 

We first introduee some basie definitions. Let n be a positive integer. A square matrix P = 
{Pij}nxn is said to be stochastic if Pij > 0 for all i, j e { 1 , ... ,n} = J\f, and YTj=iPij = 1 
for all i = 1 ,.. . ,n. Consider a stoehastie matrix P. For a set ^ C J\f, the set of one-stage 
consequent indices [l22ll of A is defined by 

Fp{A) = {j : Pij > 0 for some i e A} 

and we eall Fp the eonsequent funetion of P. For a singleton {i}, we write Fp{i) instead 
of Fp{{i}) for simplieity. A matrix P is indeeomposable and aperiodie, and thus ealled an 
SIA matrix, if lirnm-s-oo = Ic^, where 1 is the n-dimensional all-one eolumn veetor, and 
c = [ci,...,c„]^ is some eolumn veetor satisfying c* > 0 and = 1- T* is said to 

belong to the Sarymsakov class or equivalently P is a Sarymsakov matrix if for any two disjoint 
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nonempty sets A, A'^M, either 

Fp(^)nFp(^)^0, (2) 

or 

Fp{A) n Fp{A) = 0 and \Fp{A) U Fp(^)| > \AU A\, (3) 

where |^| denotes the eardinality of A. We say that P is a scrambling matrix if for any pair of 
distinet indiees j G M, Fp{i) n Fp{j) ^ 0, whieh is equivalent to requiring that there always 
exists an index k e M sueh that both pik and pjk are positive. 

From the definitions, it should be obvious that a scrambling matrix belongs to the Sarymsakov 
class. It has been proved in ll22l that any product of n — 1 matrices from the Sarymsakov class is 
scrambling. Since a stochastic scrambling matrix is SIA [|23]|, any stochastic Sarymsakov matrix 
must be an SIA matrix. 

Definition 1: {Consensus set) Let P be a set of n x n stochastic matrices. P is a consensus 
set if for each sequence of matrices P(l), P(2), P(3),... from P, P{k) ■ ■ ■P(l) converges to 
a rank-one matrix Ic^ as A; —)■ cx), where c, > 0 and 

Deciding whether a set is a consensus set or not is critical in establishing the convergence of 
the state of system ([1]) to a common value. Necessary and sufficient conditions for P being a 
consensus set have been established ifTTl . If2^ . Il23l . ifT^ . llISll . 

Theorem 1: ll25ll Let P be a compact set of n x n stochastic matrices. The following conditions 
are equivalent: 

1) P is a consensus set. 

2) For each integer A: > 1 and any P{i) G P, 1 < A < A;, the matrix P{k) ■ ■ ■ P(l) is SIA. 

3) There is an integer u > 1 such that for each k > u and any P{i) G P, 1 < i < k, the 
matrix P(A:) ■ ■ ■ P(l) is scrambling. 

4) There is an integer p > 1 such that for each k > p and any P{i) G P, 1 < i < k, the 
matrix P{k) ■ ■ ■ P(l) has a column with only positive elements. 

5) There is an integer a > 1 such that for each k > a and any P{i) G V, 1 < i < k, the 
matrix P{k) ■ ■ ■P(l) belongs to the Sarymsakov class. 

For a compact set P to be a consensus set, it is necessary that every matrix in P is SIA in view 
of item (2) in Theorem [B If a set of SIA matrices is closed under matrix multiplication, then one 
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can easily conclude from item (2) that its compact subsets are all consensus sets. However, it is 
well known that the product of two SIA matrices may not be SIA. The stochastic Sarymsakov 
class is the largest known set of stochastic matrices, which is closed under matrix multiplication. 
Whether there exists a larger class of SIA matrices, which contains the Sarymsakov class as a 
proper subset and is closed under matrix multiplication, remains unknown. We will explore this 
by taking a closer look at the definition of the Sarymsakov class and study the properties of 
classes of generalized Sarymsakov matrices that contain the Sarymsakov class as a subset. 

III. SIA INDEX 

The key notion in the definition of the Sarymsakov class is the set of one-stage consequent 
indices. We next introduce the notion of the set of k-stage consequent indices and utilize this 
to define a larger matrix set, which contains the Sarymsakov class. 

For a stochastic matrix P and a set ^ C J\f, let Fp{A) be the set of k-stage consequent 
indices of A, which is defined by 

FI{A) = Fp{A) and F^(A) = Fp(F^-^(A)), k>2. 

Definition 2: A stochastic matrix P is said to belong to the class S if for any two disjoint 
nonempty subsets A, A ^ Af, there exists an integer k > 1 such that either 

Fj^{A)nFj^{A)fi^, (4) 

or 

Fj^{A) n Fj^{A) = 0 and \Fj^{A) U Fj^{A)\ > |^U^|. (5) 

It is easy to see that the Sarymsakov class is a subset of S since A; is 1 in the definition of 
the Sarymsakov class. An important property of the consequent function Fp given below will 
be useful. 

Lemma 1: [l^ Let P and Q be n X n nonnegative matrices. Then, Fpq{A) = Fq{Fp{A)) 
for all subsets A<L fif. 

A direct consequence of Lemma [His that Fpk{A) = Fp{A) for any stochastic matrix P, any 
integer k > 1 and any subset A C J\f. 

The following theorem establishes the relationship between the matrices in S and SIA matrices. 

Theorem 2: lf231 A stochastic matrix P is in 5 if and only if P is SIA. 
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From Theorem 4.4 in we know the following result. 

Theorem 3: A stoehastie matrix P is SIA if and only if for every pair of indiees i and 

j, there exists an integer k, k < n{n — l)/2, sueh that Fp{i) fl Fp{i) ^ 0. 

Theorem [3] implies that the index fc in (jH) and dS]) ean be bounded by some integer. 

Lemma 2: A stoehastie matrix P is SIA if and only if for any pair of disjoint nonempty sets 
A, A<L J\f, there exists an index k, k < n{n — l)/2, sueh that Fp{A) fl Fp{A) ^ 0. 

Example 1: Let 

111 
3 3 3 


P = 


1 0 0 
0 1 0 


( 6 ) 


F is a stoehastie matrix. Consider two disjoint nonempty sets A = {2},^ = {3}. One knows 
that Fp(^) = {1} and Fp(^) = {2}, implying that Fp(^)nFp(^) ^ 0 and |Fp(^)UFp(^)| = 
|^U^|. Therefore, P is not a Sarymsakov matrix. However, the faet that Fp{A) = {1,2,3} 
and Fp{A) = {2} shows that Fp{A) n Fp{A) ^ 0. This means (111) holds for A; = 2. 

For every other pair of disjoint nonempty sets A,A'PM, it ean be verified that Fp{A) fl 
Fp{Ai} 7 ^ 0. One has that though P is not a Sarymsakov matrix, P is an SIA matrix from 
Lemma [2l □ 

From the above example and Lemma [2l one knows that the elass of SIA matriees may eontain 
a large number of matriees that do not belong to the Sarymsakov elass. Starting from the 
Sarymsakov elass, where /c = 1 in dH) and dS]), we relax the eonstraint on the value of the index 
/c in dll) and dSl), i.e., allowing for A; < 2, A: < 3,..., and obtain a larger set eontaining the 
Sarymsakov elass. We formalize the idea below and study whether the derived set is elosed 
under matrix multiplieation or not. 

Consider a fixed integer n. Denote all the unordered pairs of disjoint nonempty sets of M as 
(^ 1 , ^i),..., {Am, Am), where m is a finite number. 

Definition 3: Let P E IR”^” be an SIA matrix. For eaeh pair of disjoint nonempty sets 
Ai, Ai P fif, i = 1,..., m, let Sj be the smallest integer sueh that either dll) or dSl) holds. The 
SIA index s of P is s = max{si, S 2 , ■ ■ ■, Sm}- 

From Lemma [2l we know that for an SIA matrix F, its SIA index s is upper bounded by 
n{n — l)/2. Assume that the largest value of the SIA indiees of all the n x n SIA matriees is 
I, whieh depends on the order n. We define several subsets of the elass of SIA matriees. For 
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1 < k < I, let 

Vfc = {P G ]R"^^"|P is SIA and its SIA index is k} (7) 

and 


= utiV.. 


( 8 ) 


Obviously iSi C 1 S 2 C ■ ■ ■ C 5/ and iSi = Vi is the elass of stoehastie Sarymsakov matriees. 
One ean easily eheek that when n = 2, all SIA matriees are serambling matriees and henee 
belong to the Sarymsakov elass. When n > 3, the set Vn-i is nonempty. To see this, eonsider 
an n X n stoehastie matrix 

1 

n n 


I I 

n n 


p = 


1 0 
0 1 


0 0 
0 0 


_o 0 ■■■ 1 o_ 

For an index i G Af, i ^ n, it is easy to eheek that Fp~^{i) = Af. Henee, for any two nonempty 
disjoint sets A,AGAf, it must be true that Fp~^{A) fi Fp~^{A) 7 ^ 0, proving that P is an SIA 
matrix. Consider the speeifie pair of sets A = {n}, A = {n — 1}. One has that Fp -\n) = {2}, 
Fp~‘^{n — 1) = {!}, and Fp~^{n) fl Fp~^{n — 1) 7 ^ 0, implying that P G V„_i. From this 
example, we know that a lower bound for / is n — 1. 

In the next three subseetions, we first diseuss the properties of iSj, 7 = 1,...,/, then eonstruet 
a set, elosed under matrix multiplieation, eonsisting of a speeifie SIA matrix and all stoehastie 
Sarymsakov matriees, and finally diseuss the elass of pattem-symmetrie matriees. 


A. Properties of Si 

The following novel result reveals the properties of the sets Si, 1 < i < 1. 

Theorem 4: Suppose that n >3. Among the sets iSi, S 2 ,, 5;, the set Si is the only set 
that is elosed under matrix multiplieation. 

Note that a eompaet subset P of Si is a eonsensus set. However, if P is a eompaet set 
eonsisting of matriees in Vj, i > 2, Theorem |4] shows that there is no guarantee that P is still 
a eonsensus set. 
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The proof of Theorem |4] relies on the following key lemma, based on whieh the conclusion 
of Theorem m immediately follows. Before stating the lemma, we define a matrix Q in terms of 
a matrix P e V*, i>2. 

For a given matrix P G Vi, i >2, from the definition of the Sarymsakov class, one has that 
there exist two disjoint nonempty sets A, A P M such that Fp{A) fi Fp{A) = 0 and 


Fp{A)UFp{A)\ < |^U^|. 


(9) 


Define a matrix Q = {qij)nxn as follows 


1 

Ml’ 

0 , 


qa = < i 
Ml ’ 

0 , 


i e Fp{A), ] G A, 
i G Fp{A), j G A, 
i G Fp{A), j G A, 
i G Fp{A), J G A, 

otherwise, 


( 10 ) 


where A denotes the complement of A with respect to J\f. 

Lemma 3: Suppose that n > 3. For any i = 2,... ,1, given a stochastic matrix P G Vi, then 

the matrix Q given in (fT^ belongs to the set S 2 and PQ, QP are not SIA. In addition, Q G Vi 

if dH) holds with the equality sign; Q G V 2 if the inequality dH) is strict. 

Proof: Q is a stochastic matrix as each element qij, i, j = 1,... ,n is nonnegative and each 
row of Q sums up to 1. Note that for an index i G Af, the set of its one-stage consequent indices 
pQ(i) is either ^ or ^ or Af. We next show that Q belongs to the set S 2 . 

Consider two arbitrary disjoint nonempty sets C, C F Af. One of the following statements 
must hold: 

(a) C UC contains some element in Fp(A) U Fp(A); 

(b) C U C C Fp{A) U Fp{A), C n Fp{A) ^ 0, and C n Fp{A) ^ 0; 

(c) C U C C Fp{A) U Fp{A), C n Fp{A) ^ 0, and C n Fp{A) ^ 0; 

(d) C C Fp{A) and C C Fp{A); 

(e) C C Fp{A) and C C Fp{A). 

Case (a). From the definition of the matrix Q in dJO]), one has that Fq{C) or Fq (C) is the set 
Af, which implies that Fq(C) D Fq(C) 7 ^ 0. 
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Case (b). It is easy to see that ^ is a subset of both Fq{C) and Fq{C). Henee FQ{C)r\FQ{C) ^ 

0 . 

Case (c). Similar to ease (b), ^ is a subset of both Fq{C) and Fq{C). Henee Fq{C) C[Fq{C) ^ 

0 . 

Case (d). From the definition of Q, one has 

Fq{C)=A, Fq{C) = A. (11) 

Following dH), 

\Fq{C)UFq{C)\ = l^u^l > |Fp(^)UFp(^)| > |CUC|. 

If |Fp(^)UFp(^)| > |cuc|,then \Fq{C) U Fq{C)\ > \CUC\. 

If l-Fp(^) U Fp(^)| = |C UC|, we eonsider two oases 
(dl) I^U^I > |Fp(^) UFp(^)|; 

(d2) I^U^I = |Fp(^) UFp(^)|. 

Case (dl). We immediately oonolude that \Fq(C) U Fq(C)\ > |C UC|. 

Case (d2). From 

I^U^I = |Fp(^) UFp(^)| = |CUC|, 

one obtains C = Fp(A) and C = Fp(A). We further look at the sets of two-stage eonsequent 
indioes of C and C, and obtain from (fTTI) that 

F^iC) = Fq{A), F^{C) = Fq{A). 

We will show that Fq{A) n Fq(A) 7 ^ 0 from whieh we see that the smallest integer k is 
2 suoh that (Hj) holds for this pair C and C and the matrix Q. Suppose on the oontrary that 
Fq{A) n Fq{A) = 0 is true. Sinee for any i e M, FQ{i) is either ^ or ^ or J\f, the faet that 
Fq (^) n Fq (^) = 0 implies that either 


Fq(A) = A, Fq(A) = A, 

(12) 

Fq(A) = A, Fq(A) = A. 

(13) 


If (fT^ holds, then it is inferred from the strueture of the matrix Q that A C Fp(A) and 
A C Fp(^). Combining with the faet that |Fp(^) U Fp(^)| = |^ U A\, it must be true that 
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Fp{A) = A and Fp{A) = A. It then follows that Fp{A) = A and Fp{A) = A for any 
positive integer k, showing that P is not an SIA matrix in view of Lemma |2l We eonelude that 

F3(C)nF3(C)^0. 

If (fT3l) holds, then from the strueture of the matrix Q one has that A C Fp{A) and A C Fp{A). 
Similarly one obtains that Fp{A) = A and Fp{A) = A. Thus, Fp{A) fi Fp{A) = 0 for any 
positive integer k, implying that P is not an SIA matrix based on Lemma [2l We conclude that 

F2(C)nF2(C)^0. 

Case (e). The discussion is similar to that in case (d). 

Therefore, summarizing the discussions in all cases, we have shown that Q G Vi if dH) holds 
with the equality sign; Q e V 2 if the inequality dH) is strict. 

We next look at the matrix product FQ. Consider the pair of sets A and A. One has 

Fpq{A) = Fq{Fp{A)) = A Fpq{A) = Fq{Fp{A)) = A. (14) 

Thus, for any positive integer k, F^q{A) = A and Fpq{A) = A. PQ is not an SIA matrix. 
Similarly, one can see that 

Fqp{Fp{A)) = Fp{A), Fqp{Fp{A)) = Fp{A), (15) 

implying that QP is not an SIA matrix. □ 

Remark 1: Note that whether a stochastic matrix is SIA or not only depends on the positions 
of its nonzero elements but not their magnitudes. One can derive other matrices based on Q in 
dini) such that PQ is not SIA by varying the magnitudes of the positive elements of Q as long 
as each row sum equals to 1 and the positive elements are kept positive. 

There has been research work on defining an other class of matrices that is a subset of the 
SIA matrices and larger than the stochastic scrambling matrices. We establish its relationship 
with the stochastic Sarymsakov class in view of Lemma [3l 
Definition 4: ll23l P G if P is SIA and for any SIA matrix Q, QP is SIA. 

Proposition 1: For n > 3, ^ is a proper subset of the class of stochastic Sarymsakov matrices 
5i. 

Proof. Obviously ^ is a subset of S. For any P E Vi, f > 2, P is not an element of Q since 
there exists an SIA matrix Q such that QP is not SIA from Lemma [3l Hence ^ is a subset of 
5i. 
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For n > 3, let 


1 

2 

1 

2 

0 

0 ■■ 

1- 

O 

0 

0 

1 

0 ■■ 

■ 0 

1 

1 

1 

1 

1 

n 

n 

n 

n 

n 

1 

1 

1 

i 

j_ 

n 

n 

n 

n 

n 

1 

1 

1 

i 

j_ 

n 

n 

n 

n 

n_ 


One can verify that P E Si. We show that P ^ Q. Consider the following matrix 

1 0 0 0 ■■■ 0 

1 0 0 0 ■■■ 0 

0 1 0 0 ■■■ 0 

Q = 

i i i i ... i 

n n n n n 


1 

n 


1 

n 


1 

n 


1 


nj 


Q is also an SIA matrix since the first column of is positive. However, 

'i i 0 0 ■■■ o' 

i i 0 0 ■■■ 0 

0 0 1 0 ■■■ 0 


QP = 


+ + + + ••• + 

+ + + + ■•• + 


where “+” denotes an element that is positive. For two disjoint nonempty sets A = {1,2},^ = 
{3}, F*p(.4) = A and Fqp{A) = A for any positive integer k and hence QP is not an SIA 
matrix. P is a stochastic Sarymsakov matrix not in Q. This completes the proof. □ 


B. A set closed under matrix multiplication 

In this subsection, we construct a subset of S, which is closed under matrix multiplication. 
This subset consists of the set iSi and one specific matrix in V 2 . 

Let P be a matrix in V 2 and satisfies that for any disjoint nonempty sets A., A P M, either 

FR{A)nFR{A)y^^, (16) 
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or 


Fr{A) n Fn{A) = 0 and \Fn{A) U Fn{A)\ > |^ U ^|. 


Such a matrix exists. An example is 


R = 


i 1 1 i 

n n n n 

10 0 0 

0 10 0 

1111 


n 

0 

0 

I 

n 


(17) 


(18) 


1 i i 1 . . . 1 

.n n n n n_ 

To verify that R satisfies this eondition, we only have to eonsider the pair of sets ^ = {2}, A = 
{3} sinee for other pairs of A, A, Fji{A) fi Fr{A) ^ 0. It is elear that \Fr{2) U Fr(3)| = 
|{1,2}| = I.4U.4I and f|(2)nf|(3) = {1}. 

Theorem 5: Suppose that i? is a matrix in V 2 and satisfies that for any disjoint nonempty sets 
A, AfM, (fT^ or (fTTI) holds. Then, the set is elosed under matrix multiplieation 

and a eompaet subset of is a eonsensus set. 

Proof: Let P be a matrix in iSi. We first show that PP, PR G iSi. Given two disjoint nonempty 
sets A, A F M, assume that Frp{A) fi Frp{A) = 0. Sinee Frp{A) = Fp{Fr{A)) and 
Frp{A) = Fp{Fr{A)) based on Lemma [U one has that Fr{A) fi Fr{A) = 0. In view of the 
faet that P is a Sarymsakov matrix, one has 


Frp{A)UFrp{A)\ = \Fp{Fr{A))UFp{Fr{A))\ 


> \Fr{A)UFr{A)\ 


> |^u^|. 


It follows that PP is a Sarymsakov matrix. Consider the matrix PP. Suppose that A, A F J\f 
are two disjoint nonempty sets satisfying that Fpp{A) nFpp{A) = 0. One similarly derives that 

|Pp^(^)UPp^(^)| = \Fp{Fp{A))UFr{Fp{A))\ 

> \Fp{A) U Fp{A)\ 

> |^U^|. 

Therefore, PP is a Sarymsakov matrix. 
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We next show that G iSi. Sinee R e V 2 , for any disjoint nonempty sets A, A'^ M, there 
exists an integer k <2 sueh that either 

(19) 

or 

F^(^) n F^{A) = 0, and \F^{A) U F^{A)\ > |^ U ^|. (20) 

When (fT9l) holds, it follows from Lemma[I]that Fji 2 {A)r\Fji 2 {A) 7 ^ 0. When (l20l) holds, suppose 
that Fr 2 {A) n F^ 2 {A) = 0. If (I 20 I) holds for k = 1, then from the assumption on R, we have 

\Fr 2 {A)UFr 2 {A)\ > \FR{A)UFn{A)\ > |^U^|; 

if (I 20 I) holds for k = 2, then we immediately have that \Fji 2 {A) U Fji 2 {A)\ > U ^|. Henee, 
R^ e Si. 

Reeall that the produet of matriees in iSi still lies in iSi. It is elear that P 2 P 1 is a Sarymsakov 
matrix for Pi, P 2 ^ S[. By induetion Pfc • • ■ P 2 P 1 G iSi for P, e i = 1,..., fc, and any integer 
k >2, implying that iSj is elosed under matrix multiplieation. Then, it immediately follows from 
Theorem [T] (5) that a eompaet subset of iS( is a eonsensus set. □ 

For a set eonsisting of the Sarymsakov elass and two or more matriees whieh belong to V 2 
and satisfy that for any disjoint nonempty sets A, A F J\f, (fT^ or (fTTl) holds, whether it is 
elosed under matrix multiplieation depends on those speeifie matriees in V 2 . 

C. Pattern-symmetric matrices 

In this subseetion, we diseuss the SIA index of a elass of n x n stoehastie matriees, eaeh 
element P of whieh satisfies the following pattern-symmetrie eondition 

Pij > 0 pji > 0 , for i 7 ^ j. ( 21 ) 

System ([T]) with bidireetional interaetions between agents induees a system matrix satisfying 
(I 2 TI) . whieh arises often in the literature. 

We present the following lemma regarding the property of a matrix satisfying (l2TI) . 
Proposition 2: Suppose that P satisfies (|2TI) and is an SIA matrix. Then, 

1) Pe52; 

2) if P is symmetrie, then P E Si. 
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Proof: (1) Suppose the eontrary holds. Then, there exist two disjoint nonempty sets M, 

sueh that 

Fl,{A) n Fl,{A) = ^ and |F|(^)UF|(^)| <\AuA\. 

Sinee (1^ holds, one ean eonelude that for any nonempty set C C AA, C C Fp{C), implying that 
\Ff{A) U Ff{A)\ > 1^ U ^|. It follows that \Ff{A) U Ff{A)\ = |^ U ^|. Then, Ff{A) = A 
and Fp(A) = A, whieh implies that Fp{A) nFp{A) = 0 for any integer k. This eontradiets the 
faet that P is an SIA matrix in view of Lemma [2l We then have P G 1 S 2 . 

(2) If P ^ iSi, there exist two disjoint nonempty sets A^AFff, sueh that 

Fp{A) n Fp{A) = 0 and \Fp{A) U Fp{A)\ <\AuA\. 

Sinee for any set C Cj\f, 

Pij = \^\= Pji<\Fp{C)\, 

ieC,j&Fp{C) ieC,j€Fp{C) 

one ean only have that \Fp{A)\ = \ A\ and \Fp{A)\ = |^|. This implies 

Pji = \^piM- 

ieA,jeFp{A) 

Combined with the faet that A C Fp{A), one has that Fp{A) = A. Similarly Fp{A) = A. One 
then has that Fp{A) nPp(Al) = 0 for any integer k, eontradieting the faet that P is SIA. Henee 
P eSi. □ 

For an SIA and nonsymmetrie matrix P satisfying (|2T]) . P is not neeessarily a Sarymsakov 
matrix. An example of sueh a P is 

’0 1 

P = 2 

0 I 
0 0 

P is not a Sarymsakov matrix, but P G 1 S 2 . 

With the knowledge of the SIA index, the eondition for a eonsensus set of stoehastie symmetrie 
matriees in the literature ean be derived direetly. It has been established in Example 7 in ifT^ 
that a eompaet set P of stoehastie symmetrie matriees is a eonsensus set if and only if P is an 
SIA matrix for every P G P. The neeessity part holds for any eonsensus set. As we know from 


0 0 
i 0 

1 1 
3 3 

1 0 
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Proposition O a stochastic symmetric matrix P is SIA if and only if P is a Sarymsakov matrix. 
The suffieient part beeomes elear as the Sarymsakov elass is elosed under matrix multiplieation. 

The above elaim for stoehastie symmetrie matriees eannot be extended to stoehastie matriees 
that satisfy (1^ . The reason is that a stochastic matrix satisfying (|2TI) . is not necessarily a 
Sarymsakov matrix. Henee, in view of Theorem S the produet of two sueh matriees may not 
be SIA anymore. An example to illustrate this is a set P eonsisting of two matriees 


-1 

o 

1 

0 

1 

O 


1 

o 

1 

2 

0 

l" 

2 

1 

0 

1 

0 


1 

0 

0 

0 

2 


2 


, A = 


0 

1 

3 

1 

3 

1 

3 


0 

0 

0 

1 

o ^ 

0 

1 

0_ 


1 

.3 

0 

1 

3 

1 

3. 


Pi,P 2 both satisfy (1211) . However, the matrix product {P 1 P 2 Y does not eonverge to a rank-one 
matrix as A; —>■ 00 . 


IV. A CLASS OF GENERALIZED SARYMSAKOV MATRICES 

We have seen in Theorem |5] that the Sarymsakov elass plus one speeifie SIA matrix ean lead 
to a elosed set under matrix multiplieation that eontains iSi. The property (fTV]) of the matrix R 
turns out to be critieal and we next eonsider a elass of matrices containing all such matrices. 

Definition 5: A stoehastie matrix P is said to belong to a set W if for any two disjoint 
nonempty sets A, A P fif, either (fT^ or (fTTl) with R replaeed by P holds. 

The definition of the set W relaxes that of the Sarymsakov elass by allowing the inequality in 
dU) not to be striet. It is obvious that iSi is a subset of W. In addition, W is a set that is elosed 
under matrix multiplieation. To see this, we show PQ G W for P, Q G W. For any two disjoint 
nonempty sets A, AP fif, suppose that Fpq{A) fi Fpq{A) = 0. It follows from (fTVl) that 

\FpQiA)UFpQiA)\ = |Pq(Pp(^))UPq(Pp(^))| 

> \Fp{A) U Fp{A)\ 

> l^u^l, 

whieh implies that PQ ^ W. 

Compared with the definition of iSi, the subtle differenee in the inequality in (fTVl) drastieally 
ehanges the property of W. A matrix in W is not neeessarily SIA. For example, permutation 
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matrices belong to the class W since for any disjoint nonempty sets A, AC J\f, 

Fp{A) n Fp{A) = 0 and \Fp{A) U Fp{A) \ = \AuA\. (22) 


One may expect that the set W fl 5 is closed under matrix multiplication. However, the claim 
is false and an example to show this is the following two SIA matrices 


1 

3 

1 

3 

1 

3 


0 

1 

1 - 

o 

1 

0 

0 

, P2 = 

0 

0 

1 

1 - 

o 

1 

1 

o 


1 

_3 

1 

3 

1 

3_ 


where 


P1P2 


0 1 0 
0 0 1 


is not SIA anymore. 

Instead of looking at whether a subset of W is a consensus set which concerns the convergence 
of the matrix product formed by an arbitrary matrix sequence from the subset, we explore the 
sufficient condition for the convergence of the matrix product of the elements from W and its 
application to doubly stochastic matrices. 


A. Sufficient conditions for consensus 

Theorem 6: Let P be a compact subset of W and let P(l), P(2), P(3),... be a sequence 
of matrices from V. Suppose that - is an infinite increasing sequence of the indices 

such that P(ji),P(j 2 ), • • • are Sarymsakov matrices and U“i{P(>)} is a compact set. Then, 
P{k) ■ ■ ■P(l) converges to a rank-one matrix as /c ^ cxd if there exists an integer T such that 

jr+i — jr FT for all r > 1. 

Proof: Let be an integer such that (/cq — 1)T + 1 > ji. Since jr+i — jr FT for all r > 1, 
one has that for any integer k > ko, the matrix sequence P(/cT),...,P((/c — 1)T + 1) contains 
at least one Sarymsakov matrix, i.e., there exists an integer 4 depending on /c, 1 < 4 < T, such 
that P{{k — 1)T + 4) G Si- 

We prove that for every integer k > ko, P{kT) ■ ■ ■ P{{k — 1)T + 1) is a Sarymsakov matrix. 
We only consider those pairs of disjoint nonempty sets A, A satisfying 

Fp(kT)-P({k-l)T+l){.A) n Fp(^kT)---P({k-l)T+l)iA) = 0. 
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Since P{{k — 1)T + 4) G Si, combining with the property of the class W, it follows that 

\Fp{kT)-P({k-l)T+l){^) U Fp(^kT)-P{(k-l)T+l){^)\ 

P\Fp(kT)---P{{k-l)T+2)i^) U Fp(^kT)---P{{k-l)T+2)i^) \ > ' ' ' 

>\Fp(kT)-p{(k-i)T+ik)i-^) U -^P(fcr)-p((fc-i)r+ife)(-4.)| 
>\Fp(kT)-p{{k-i)T+ik+i){'^) U -^p(fcT)-p((fc-i)r+4+i)(-^)| 

>••• > |^u^|. 

Therefore, F{kT) ■ ■ ■F{{k — 1)T + 1) is a Sarymsakov matrix. 

Define V* = U“ i{P(jr)} and Qp = {Pp ■ ■ ■ P 2 Pi\Pi e P, i = 1,..., T, G P* for some 
1 < s < T}. Qp is a compact set since both P and V* are compact. Note that the matrices 
P{kT)---P{{k-l)T + l) G QTforallfc > ko and all matrices in Qp are Sarymsakov matrices 
from the above discussion. From Theorem [U we know that 

lim P{kT)P{kT - 1) • ■ ■ P((fco - 1)T + 1) = Ic'^, 

fc—)-oo 

for some nonnegative normalized vector c. For any integer s > 1, there exists an integer k such 
that kT + 1 < s < (fc + 1)T. Let 11 ■ 11 be the infinity norm of a matrix. We have 

\\P{s) • • ■ P(2)P(1) - Ic^Piiko - 1)T) ■ ■ ■ P(l) 11 

= ||P(s) • ■ ■P(l) - P{s) ■ ■ ■ P{kT + l)lJP{{ko - 1)T) ■ ■ ■ P(l)|| 

<||P(s) • ■ ■P(fcT + 1)11 ■ ||P(A:T) ■ ■■P{{ko - 1)T + 1) - lJ\\ 

■\\P{{ko-l)T)---P{l)\\ 

<\\P{kT)---P{{ko-l)T + l)-lc^\\. 

Thus, the matrix product P(s) • • ■ P(2)P(1) converges to a rank-one matrix as s goes to infinity. 
□ 

Remark 2: In Theorem if P = j^+i — jr, r > 1 is not uniformly upper bounded, we may 
not be able to draw the conclusion. The reason is that ^^iQp^ (Qxr can be defined similarly 
to Qp) is not necessarily compact so that the conditions in Theorem [T] do not apply. 

When the set P is a finite set, we have the following corollary. 

Corollary 1: Let P be a finite subset of W and let P(l), P(2), P(3),... be a sequence of 
matrices from P. Suppose that ji,P,... is an infinite increasing sequence of the indices such 
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that P(ji), P(j 2 ), • • • are Sarymsakov matrices. Then, P(A;)---P(1) converges to a rank-one 
matrix as /c —)■ cx3 if there exists an integer T such that — jr <T for all r > 1. 

B. Applications to doubly stochastic matrices 

In fact, the set of matrices W contains all doubly stochastic matrices. We can establish the 
following property of doubly stochastic matrices using the Birkhoff-von Neumann theorem [|T7]| . 
Lemma 4: Let P be a doubly stochastic matrix. For any nonempty set A C J\f, \Fp(A) \ > |^|. 
Proof: From the Birkhoff-von Neumann theorem llTTIl . P is doubly stochastic if and only if 
P is a convex combination of permutation matrices, i.e., P = YllLi where Ylt=i = 1’ 
Oj > 0 for i = 1,..., n! and Pj are permutation matrices. For any permutation matrix Pi, it is 
obvious that \FpfA)\ = |^| for any set A C J\f. In view of the Birkhoff-von Neumann theorem, 
it holds that 

Fp{A) = Uai^oFpfA). 

It then immediately follows that |Pp(^)| > |^|. □ 

From the above lemma, it is easy to see that for a doubly stochastic matrix P, either (fT^ or 
(fTTl) holds. Hence doubly stochastic matrices belong to the set W. The following lemma reveals 
when a doubly stochastic matrix is a Sarymsakov matrix. 

Lemma 5: Let P be a doubly stochastic matrix. P is a Sarymsakov matrix if and only if for 
every nonempty set AFff, \Fp{A)\ > |^|. 

Proof: The sufficiency part is obvious. We prove the necessity. Suppose on the contrary that 
there exists a nonempty set A C. J\f such that \Fp{A)\ < |^|. It follows from Lemma |4] that 

|Pp(^)| = |^|= p,,. (23) 

i&A,j&Fp(A) 

Since P is doubly stochastic, 

Pij = |pp(^)i - 

ieA,jGFp{A) ieA,jeFp{A) 

It follows that Fp{A) C Fp{A). Lemma S] implies that 

\Fp{A)\>\A\ = n-\A\ = \F;{A)\. 

One can conclude that \Fp{A)\ = n — \ A\ and Fp{A) = Fp{A). Then, 

Fpi^A) n Fpi^A) = 0, and \Fp(^A) U Fpi^A) \ = n = \A U A \, 
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which contradicts the fact that P is a Sarymsakov matrix. □ 

Lemma |5] provides a eondition to deeide whether a doubly stoehastie matrix belongs to iSi or 
not. We have the following eorollary based on Theorem 

Corollary 2: Let P be a eompaet set of doubly stoehastie matriees and let P(l), P(2), P(3),... 
be a sequenee of matriees from V. Suppose that ji,j 2 ,... is an infinite inereasing sequenee of 
the indiees sueh that P(ji),P(j 2 ),... are Sarymsakov matriees and U'^i{P{jr)} is a eompaet 
set. Then, P{k) ■ ■ ■P(l) eonverges to a rank-one matrix as fc —)■ cx3 if there exists an integer T 
sueh that — jr for all r > 1. 

For doubly stoehastie matriees with positive diagonals, a sharp statement ean be stated. 

Proposition 3: Let P be a doubly stoehastie matrix with positive diagonals. If P is SIA, then 
P G 5i. 

Proof: Sinee the diagonal elements of P are all positive, for any nonempty set A C J\f, 
A C Fp[A). Assume that P ^ iSi. It follows from Lemmas |4] and |5] that there exists a set 
Ac J\f sueh that \Fp{A)\ = |^|. One has that Fp{A) = A. By the double stoehastieity of P, 
Fp{A) = A, implying that Fp{A) fl Fp{A) = 0 for any integer k > 1. This eontradiets the faet 
that P is SIA. □ 

For doubly stoehastie matriees satisfying eondition (|2TI) . we have a similar result. 

Proposition 4: Let P be a doubly stoehastie matrix satisfying eondition (|2TI) . If P is SIA, 
then P e iSi. 

Proof: Assume on the eontrary P is not a Sarymsakov matrix. In view of Lemma[51 there exists 
a set ^ C AA sueh that |^| = \Fp{A)\. From the proof of Lemma |5] one knows that (|2^ and (l24l) 
hold and in addition |^| = \Fp{A)\ = |Pp(Al)|. From eondition (l2TI) . (|2^ implies that pij = 0 
for i G Fp{A),j G A. This implies Fp{A) C A. Combined with the faet that A C Fp{A), it 
follows that A = Ff{A). Similarly one has that A = Ff{A). Therefore Fp{A) fl Fp{A) = 0 
eontraeting the assumption that P is an SIA matrix. □ 

V. Conclusion 

In this paper, we have diseussed produets of generalized stoehastie Sarymsakov matriees. With 
the notion of SIA index, we have shown that the set of all SIA matriees with SIA index no 
larger than k is elosed under matrix multiplieation only when k = 1. Suffieient eonditions for 
the eonvergenee of the matrix produet of an infinite matrix sequenee to a rank-one matrix have 
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been provided with the help of the Sarymsakov matrices. The results obtained underscore the 
critical role of the stochastic Sarymsakov class in the set of SIA matrices and in constructing a 
convergent matrix sequence to consensus. Construction of a larger set than the one constructed 
in the paper which is closed under matrix multiplication is a subject for future research. 
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